CLAIM AMENDMENTS 

IN THE CLAIMS : 

Please amend claim 24 as follows: 

1 (Original). A system for tracking at least one object in at least one sequential 
image, comprising: 

a general purpose computing device; and 

a computer program comprising program modules executable by the 
computing device, wherein the computing device is directed by the program modules of 
the computer program to: 

(a) generate a state estimate defining probabilistic configurations of 
each object for each sequential image; 

(b) generate observations of pixel color for each sequential image; 

(c) automatically learn a color-based object model using the state 
estimate and the observations; and 

(d) automatically track each object using the learned color-based 
model with a color-based tracking function. 

2 (Original). The system of claim 1 wherein generating the state estimate 
comprises determining the probabilistic configurations of each object using an initial 
image processing program module. 

3 (Original). The system of claim 2 wherein the initial image processing program 
module employs a tracking system comprising a tracking function in combination with 
an object model for probabilistically detecting object configuration information. 

4 (Original). The system of claim 2 wherein the initial image processing program 
module employs a contour-based tracking function in combination with a contour-based 
object model for probabilistically detecting object configuration information. 
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5 (Original). The system of claim 1 wherein generating the observations of pixel 
color comprises collecting pixel color information over the entirety of each image. 

6 (Original). The system of claim 1 wherein generating the observations of pixel 
color comprises collecting pixel color information over specific portions of each image. 

7 (Original). The system of claim 6 wherein the program module for generating 
the observations of pixel color employs the state estimate to identify specific relevant 
regions of each image over which pixel color information will be collected. 

8 (Original). The system of claim 1 wherein generating the observations of pixel 
color comprises automatically generating a first probability distribution function modeled 
using a first histogram to represent a range of observed pixel colors. 

9 (Original). The system of claim 8 wherein the histogram is represented by a 
Dirichlet function. 

10 (Original). The system of claim 8 wherein the program module for 
automatically learning the color-based object model automatically computes a second 
probability distribution function modeled using a second histogram to represent a 
background for each image. 

1 1 (Original). The system of claim 10 where a preliminary color-based model 
represented by a third probability distribution function modeled using a third histogram 
is used to weight the first and second histograms. 

12 (Original). The system of claim 10 wherein the first and second histograms 
are automatically weighted in relation to the expected relative areas of object and non- 
object areas, respectively, within each image. 
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13 (Original). The system of claim 10 wherein automatically learning the color- 
based object model comprises performing a bin-by-bin comparison between the first 
histogram and the second histogram. 

14 (Original). The system of claim 13 wherein bins in the first histogram having 
values exceeding corresponding bins in the second histogram correspond to those 
color ranges representing the learned color-based object model. 

15 (Original). A computer-implemented process for generating a color-based 
object model, comprising: 

generating a state estimate defining probabilistic states of an object for 

each of at least one sequential images; 

generating observations of pixel color for each sequential image; and 
automatically learning the color-based object model using the state 

estimates and the observations. 

16 (Original). The computer-implemented process of claim 15, further comprising 
using the learned color-based object model in a tracking system for identifying a 
configuration at least one target object in each sequential image. 

17 (Original). The computer-implemented process of claim 15 wherein a 
confidence measure is associated with the observations of pixel color. 

18 (Original). The computer-implemented process of claim 17 wherein the 
observations of pixel color are weighted in proportion to the confidence measure. 

19 (Original). The computer-implemented process of claim 15 wherein the 
observations of pixel color are collected for each entire image. 
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20 (Original). The computer-implemented process of claim 15 wherein 
observations of pixel color are collected over specific portions of each image wherein 
the state estimate has a probability greater than a minimum threshold level. 

21 (Original). The computer-implemented process of, claim 15 wherein the 
observations of pixel color are represented by a first probability distribution function 
modeled using a first histogram. 

22 (Original). The computer-implemented process of claim 21 further comprising 
a background image for probabilistically representing a known fixed state relative to 
each image, and wherein the background image is represented by a second probability 
distribution function modeled using a second histogram. 

23 (Original). The computer-implemented process of claim 22 further comprising 
a preliminary color-based model for roughly representing each target object is 
represented by a third probability distribution function modeled using a third histogram. 

24. (Currently Amended). The computer-implemented process of claim=24= 23 
wherein the first and second histograms are scaled in relation to expected relative 
areas of object and non-object areas, respectively, within each image. 

25 (Original). The computer-implemented process of claim 24 wherein the first 
and second histogram are weighted in relation to the third histogram. 

26 (Original). The computer-implemented process of claim 24 wherein the 
second histogram is subtracted from the first histogram via a bin-by-bin comparison 
between the first and second histogram. 

27 (Original). The computer-implemented process of claim 26 wherein the 
subtraction yields a fourth histogram for representing the learned color-based object 
model. 
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28 (Original). The computer-implemented process of claim 15 wherein 
generating the state estimate comprises processing each image with an initial object 
model and an initial tracking function. 

29 (Original). The computer-implemented process of claim 28 wherein the initial 
object model is iteratively replaced with the learned color-based object model and the 
initial tracking function is replaced with a color-based tracking function to improve the 
accuracy of the learned color-based object model. 

30 (Original). The computer-implemented process of claim 23 wherein the 
preliminary color-based model is iteratively replaced with the learned color-based object 
model to improve the accuracy of the learned color-based object model. 

31 (Original). The computer-implemented process of claim 30 wherein 
generating the state estimate comprises processing each image with an initial object 
model and an initial tracking function. 

32 (Original). The computer-implemented process of claim 31 wherein the initial 
object model is iteratively replaced with the learned color-based object model and the 
initial tracking function is replaced with a color-based tracking function to improve the 
accuracy of the learned color-based object model. 

33 (Original). The computer-implemented process of claim 15 further comprising 
a process for gathering the sequential images. 

34 (Original). A computer-readable memory for identifying the configuration of 
objects of interest in a scene, comprising: 

a computer-readable storage medium; and 

a computer program comprising program modules stored in the storage 
medium, wherein the storage medium is so configured by the computer program that it 
causes the computer to, 
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generate an initial configuration estimate for objects of interest 

within the scene, 

identify pixel color information within the scene that is relevant to a 
learned color-based object model, 

automatically learn the color-based object model by determining 
probabilistic relationships between the initial configuration estimates and the pixel color 
information, and, 

generate a final configuration estimate for objects of interest in the 
scene by using the color-based object model in combination with a color-based tracking 
function. 

35 (Original). The computer-readable memory of claim 34 wherein the program 
module for generating the initial configuration estimate further includes an initial object 
model and an initial tracking function, and wherein the initial object model is comprised 
of parameters used by the initial tracking function for determining the configuration of 
objects within the scene. 

36 (Original). The computer-readable memory of claim 35 wherein the pixel color 
information is represented using a probability distribution function modeled by a first 
Dirichlet function. 

37 (Original). The computer-readable memory of claim 36 further comprising a 
background image representing the scene, and wherein the background image is 
represented using a probability distribution function modeled by a second Dirichlet 
function. 

38 (Original). The computer-readable memory of claim 37 wherein the program 
module for automatically learning the color-based object model further includes a 
preliminary color-based object model represented by a third Dirichlet for establishing a 
probabilistic baseline to assist in learning the learned color-based object model. 
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39 (Original). The computer readable memory of claim 37 wherein the program 
module for automatically learning the color-based object model automatically scales the 
first and second Dirichlet functions based on expected areas of objects of interest in the 
scene relative to areas of the scene not expected to contain objects of interest. 

40 (Original). The computer readable memory of claim 38 wherein the program 
module for automatically learning the color-based object model automatically uses the 
third Dirichlet function to weight the first and second Dirichlet functions. 

41 (Original). The computer readable memory of claim 39 wherein the program 
module for automatically learning the color-based object model automatically 
determines the difference between the first and second Dirichlet functions to generate 
the learned color-based object model. 

42 (Original). The computer readable memory of claim 40 wherein the program 
module for automatically learning the color-based object model automatically 
determines the difference between the first and second Dirichlet functions to generate 
the learned color-based object model. 

43 (Original). The computer-readable memory of claim 41 wherein the learned 
color-based object model is represented using a probability distribution function 
modeled by a fourth Dirichlet function. 

44-47. (RESTRICTED) 
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AMENDMENTS TO CLAIMS 

IN THE CLAIMS : 

Please amend claim 24 as follows: 



1 (Original). A system for tracking at least one object in at least one sequential 
image, comprising: 

a general purpose computing device; and 

a computer program comprising program modules executable by the 
computing device, wherein the computing device is directed by the program modules of 
the computer program to: 

(a) generate a state estimate defining probabilistic configurations of 
each object for each sequential image; 

(b) generate observations of pixel color for each sequential image; 

(c) automatically learn a color-based object model using the state 
estimate and the observations; and 

(d) automatically track each object using the learned color-based 
model with a color-based tracking function. 

2 (Original). The system of claim 1 wherein generating the state estimate 
comprises determining the probabilistic configurations of each object using an initial 
image processing program module. 

3 (Original). The system of claim 2 wherein the initial image processing program 
module employs a tracking system comprising a tracking function in combination with 
an object model for probabilistically detecting object configuration information. 

4 (Original). The system of claim 2 wherein the initial image processing program 
module employs a contour-based tracking function in combination with a contour-based 
object model for probabilistically detecting object configuration information. 
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5 (Original). The system of claim 1 wherein generating the observations of pixel 
color comprises collecting pixel color information over the entirety of each image. 

6 (Original). The system of claim 1 wherein generating the observations of pixel 
color comprises collecting pixel color information over specific portions of each image. 

7 (Original). The system of claim 6 wherein the program module for generating 
the observations of pixel color employs the state estimate to identify specific relevant 
regions of each image over which pixel color information will be collected. 



8 (Original). The system of claim 1 wherein generating the observations of pixel 
color comprises automatically generating a first probability distribution function modeled 
using a first histogram to represent a range of observed pixel colors. 

9 (Original). The system of claim 8 wherein the histogram is represented by a 
Dirichlet function. 



10 (Original). The system of claim 8 wherein the program module for 
automatically learning the color-based object model automatically computes a second 
probability distribution function modeled using a second histogram to represent a 
background for each image. 



1 1 (Original). The system of claim 10 where a preliminary color-based model 
represented by a third probability distribution function modeled using a third histogram 
is used to weight the first and second histograms. 

12 (Original). The system of claim 10 wherein the first and second histograms 
are automatically weighted in relation to the expected relative areas of object and non- 
object areas, respectively, within each image. 
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13 (Original). The system of claim 10 wherein automatically learning the color- 
based object model comprises performing a bin-by-bin comparison between the first 
histogram and the second histogram. 

14 (Original). The system of claim 13 wherein bins in the first histogram having 
values exceeding corresponding bins in the second histogram correspond to those 
color ranges representing the learned color-based object model. 

15 (Original). A computer-implemented process for generating a color-based 
object model, comprising: 

generating a state estimate defining probabilistic states of an object for 

each of at least one sequential images; 

generating observations of pixel color for each sequential image; and 
automatically learning the color-based object model using the state 

estimates and the observations. 

16 (Original). The computer-implemented process of claim 15, further comprising 
using the learned color-based object model in a tracking system for identifying a 
configuration at least one target object in each sequential image. 

17 (Original). The computer-implemented process of claim 15 wherein a 
confidence measure is associated with the observations of pixel color. 

18 (Original). The computer-implemented process of claim 17 wherein the 
observations of pixel color are weighted in proportion to the confidence measure. 

19 (Original). The computer-implemented process of claim 15 wherein the 
observations of pixel color are collected for each entire image. 
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20 (Original). The computer-implemented process of claim 15 wherein 
observations of pixel color are collected over specific portions of each image wherein 
the state estimate has a probability greater than a minimum threshold level. 

21 (Original). The computer-implemented process of claim 15 wherein the 
observations of pixel color are represented by a first probability distribution function 
modeled using a first histogram. 

22 (Original). The computer-implemented process of claim 21 further comprising 
a background image for probabilistically representing a known fixed state relative to 
each image, and wherein the background image is represented by a second probability 
distribution function modeled using a second histogram. 

23 (Original). The computer-implemented process of claim 22 further comprising 
a preliminary color-based model for roughly representing each target object is 
represented by a third probability distribution function modeled using a third histogram. 

24. (Currently Amended). The computer-implemented process of claim=24- 23 
wherein the first and second histograms are scaled in relation to expected relative 
areas of object and non-object areas, respectively, within each image. 

25 (Original). The computer-implemented process of claim 24 wherein the first 
and second histogram are weighted in relation to the third histogram. 

26 (Original). The computer-implemented process of claim 24 wherein the 
second histogram is subtracted from the first histogram via a bin-by-bin comparison 
between the first and second histogram. 

27 (Original). The computer-implemented process of claim 26 wherein the 
subtraction yields a fourth histogram for representing the learned color-based object 
model. 



28 (Original). The computer-implemented process of claim 15 wherein 
generating the state estimate comprises processing each image with an initial object 
model and an initial tracking function. 

29 (Original). The computer-implemented process of claim 28 wherein the initial 
object model is iteratively replaced with the learned color-based object model and the 
initial tracking function is replaced with a color-based tracking function to improve the 
accuracy of the learned color-based object model. 

30 (Original). The computer-implemented process of claim 23 wherein the 
preliminary color-based model is iteratively replaced with the learned color-based object 
model to improve the accuracy of the learned color-based object model. 

31 (Original). The computer-implemented process of claim 30 wherein 
generating the state estimate comprises processing each image with an initial object 
model and an initial tracking function. 

32 (Original). The computer-implemented process of claim 31 wherein the initial 
object model is iteratively replaced with the learned color-based object model and the 
initial tracking function is replaced with a color-based tracking function to improve the 
accuracy of the learned color-based object model. 

33 (Original). The computer-implemented process of claim 15 further comprising 
a process for gathering the sequential images. 

34 (Original). A computer-readable memory for identifying the configuration of 
objects of interest in a scene, comprising: 

a computer-readable storage medium; and 

a computer program comprising program modules stored in the storage 
medium, wherein the storage medium is so configured by the computer program that it 
causes the computer to, 



generate an initial configuration estimate for objects of interest 

within the scene, 

identify pixel color information within the scene that is relevant to a 
learned color-based object model, 

automatically learn the color-based object model by determining 
probabilistic relationships between the initial configuration estimates and the pixel color 
information, and, 

generate a final configuration estimate for objects of interest in the 
scene by using the color-based object model in combination with a color-based tracking 
function. 

35 (Original). The computer-readable memory of claim 34 wherein the program 
module for generating the initial configuration estimate further includes an initial object 
model and an initial tracking function, and wherein the initial object model is comprised 
of parameters used by the initial tracking function for determining the configuration of 
objects within the scene. 

36 (Original). The computer-readable memory of claim 35 wherein the pixel color 
information is represented using a probability distribution function modeled by a first 
Dirichlet function. 

37 (Original). The computer-readable memory of claim 36 further comprising a 
background image representing the scene, and wherein the background image is 
represented using a probability distribution function modeled by a second Dirichlet 
function. 

38 (Original). The computer-readable memory of claim 37 wherein the program 
module for automatically learning the color-based object model further includes a 
preliminary color-based object model represented by a third Dirichlet for establishing a 
probabilistic baseline to assist in learning the learned color-based object model. 



39 (Original). The computer readable memory of claim 37 wherein the program 
module for automatically learning the color-based object model automatically scales the 
first and second Dirichlet functions based on expected areas of objects of interest in the 
scene relative to areas of the scene not expected to contain objects of interest. 

40 (Original). The computer readable memory of claim 38 wherein the program 
module for automatically learning the color-based object model automatically uses the 
third Dirichlet function to weight the first and second Dirichlet functions. 

41 (Original). The computer readable memory of claim 39 wherein the program 
module for automatically learning the color-based object model automatically 
determines the difference between the first and second Dirichlet functions to generate 
the learned color-based object model. 

42 (Original). The computer readable memory of claim 40 wherein the program 
module for automatically learning the color-based object model automatically 
determines the difference between the first and second Dirichlet functions to generate 
the learned color-based object model. 

43 (Original). The computer-readable memory of claim 41 wherein the learned 
color-based object model is represented using a probability distribution function 
modeled by a fourth Dirichlet function. 

44-47. (WITHDRAWN) 
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